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Abstract 

In their landmark paper Cover and El Gamal proposed different coding strategies for the relay channel with a 
single relay supporting a communication pair. These strategies are the decode-and-forward and compress-and-forward 
approach, as well as a general lower bound on the capacity of a relay network which relies on the mixed application 
of the previous two strategies. So far, only parts of their work - the decode-and-forward and the compress-and-forward 
strategy - have been applied to networks with multiple relays. 

This paper derives a mixed strategy for multiple relay networks using a combined approach of partial decode- 
and-forward with A*' + 1 levels and the ideas of successive refinement with different side information at the receivers. 
After describing the protocol structure, we present the achievable rates for the discrete memoryless relay channel 
as well as Gaussian multiple relay networks. Using these results we compare the mixed strategy with some special 
cases, e. g., multilevel decode-and-forward, distributed compress-and-forward and a mixed approach where one relay 
node operates in decode-and-forward and the other in compress-and-forward mode. 

Index Terms 

Relay network, discrete memoryless relay channel, Gaussian relay channel, successive refinement with unstruc- 
tured side information, degraded message set broadcast channel 

I. Introduction 

The growing popularity of mobile communications systems, sensor networks as well as ad hoc networks draws 
an increased activity in the field of network information theory and relaying in particular. The basic idea of relaying 
[1], [2] is to support a communication pair using additional radios. Two basic coding strategies for the one-relay 
case were proposed by Cover and El Gamal in [3]: decode-and-forward (DF) and compress-and-forward (CF); both 
still serve as basic building blocks of recent protocols. 

Furthermore, [3, Theorem 7] provides a general lower bound on the capacity for the one-relay case which can 
be achieved using a combination of DF and CF. More specifically, the source message is divided into two parts: 
\]\, which is decoded by the relay node, and U^, which can only be decoded if is known. As illustrated in Fig. 
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Fig. 1. Information flow of the general lower bound for flie one-relay case. 

[U the relay terminal r decodes and selects a message V using the random binning procedure introduced in [4]. 
Since the source node knows this mapping it also knows the message V and can support the relay transmitting V. 
The relay further uses Yr to quantize its uncertainty about in its channel output Yr and selects a message W 
depending on this quantization. The destination node d decodes V and uses this additional information to decode 
U^. Using the message W and the correlation between the relay and destination channel output, the destination 
decodes the quantization Y^ (a strategy similar to Wyner-Ziv coding [5]). With the quantized channel output of the 
relay and its own channel output, the destination finally decodes the second source message U^. 

A. Motivation 

More recent work on relaying concentrated on the analysis of networks with multiple relays: among others, Gupta 
and Kumar derived in [6] bounds on the capacity of ad-hoc networks without cooperation between individual nodes. 
Again, Gupta and Kumar generalized in [7] the DF approach to a multilevel relaying scenario where each node 
decodes the full source message and uses irregular encoding. Later, Xie and Kumar proposed in [8], [9] a DF strategy 
based on regular encoding and successive decoding, which in general achieves higher rates than the proposal in [7]. 
Besides, Kramer et al. [10] derived different DF or CF based strategies for a variety of different relay networks 
such as the multiple access and broadcast relay channel. 

Except for [10], these approaches regard coding schemes operating either in DF or CF mode. In [10, Theorem 4] a 
mixed approach was presented where the network consists of both CF and DF nodes. Furthermore, in [10, Theorem 
5] a specific mixed protocol for two relays was presented. The motivation of this work is the development of a 
framework generalizing the previously mentioned approaches such that the protocol with the best performance or 
lowest complexity can be found for a specific network setup. One way is to derive different protocols and compare 
them to each other which obviously is not an efficient solution. Therefore, we follow in this work a similar approach 
as [3, Theorem 7] and derive a strategy which is able to specialize to different protocols depending on the actual 
network setup. This might be of special interest for instance in ad-hoc networks or mobile communications systems 
where it is necessary to use low complex protocols. Hence, it is beneficial to support a small number of low complex 
protocols which provide the best performance in specific situations instead of using one high-complex protocol. 
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B. Contribution and outline of this work 

In this work we derive such a mixed strategy which generalizes the previously mentioned approaches. The main 
idea is to divide the source message in + 1 partial messages (where N denotes the number of relays in the 
network). Each relay level / G [1; A^] decodes the first I partial messages and quantizes the remaining uncertainty 
in its own channel output. This quantization is then communicated in different successive refinement steps to the 
next levels V > I, which use this quantization to decode the partial source messages U^' with I' > k > I. 

In Section [n] we define the considered network model as well as used notations before we describe in Section Hill 
the protocol in detail and show its commonalities with the problem of successive refinement with unstructured side 
information at the receivers as well as the degraded message broadcast channel. We further derive in this section 
the achievable rates for the discrete memoryless relay channel before we apply these results to a wireless model in 
Section HV] 

II. System model, notations and definitions 

In the following we will use non-italic uppercase letters X to denote random variables, non-italic lowercase letters 
X to denote events of a random variable and italic letters (N or n) are used to denote real or complex-valued scalars. 
Ordered sets are denoted by X, the cardinality of an ordered set is denoted by ||A:'|| and [b; b + k] is used to denote 
the ordered set of numbers (6, 6 + 1, • • • ,b + k). With X ^ Px\Yix\y) we denote the random 7i-length sequence 
{X[i]}"^j^ whose elements X[t] G X are i.i.d. distributed according to some pdf Px\Yix\y) (in the following we 
will drop the subscripts if it clear from the context), i.e., p{x\y) = JltLi ly W)- be a random variable 

parameterized using k then Xc denotes the vector of all X^: with k E C (this applies similarly to sets of events). 
Matrices are denoted by boldface uppercase letters K and the i-th row and j-th column of matrix K is denoted by 

This paper considers a network of iV + 2 nodes: the source node s = 0, the set of N relays t E TZ :~ [1; N] 
and the destination node d ~ + 1. The discrete memoryless relay channel is defined by the conditional pdf 
p (yk, Yrfjxs, xtj) over all possible channel inputs (xi,--- ,xiy,Xs) E Xi x ■ ■ ■ X^ x Xs and channel outputs 
(yij ■ ■ ■ 7 JN, Yd) G 3^1 X • • • X with Xi and y,- denoting the input and output alphabets. 

We will use in the following (x",y") G At^^^^ 0^^^) to indicate that the n-length sequence tupel (x",y") G 
X" X 3^" is e-strongly typical with respect to the joint pdf p(x, y) where we abbreviate (X, Y) in the following 

by y^e''"' if it is clear from the context [11, Ch. 13.6]. Let tt{X) be the set of all permutations of a set X. The 
source chooses an ordering o^. G 7r([l; N + 1]) where Os{l) denotes the Z-th element of and Os{N + 1) = + 1. 
For the sake of readability we abbreviate in the following Yoi,{i) by Yi and the relay node Os{l) by I or as the l-th 
level. Besides, each relay I introduces an ordering o/ G t:{[1 + 1; A^ + 1]) where o;(z) indicates node Os{oi{i)). We 
further use in the following the function (f>i to denote the inverse of o;, i.e., oi{4)i{i)) = i. 

Remark 1: In comparison to [7] we do not consider any grouping approach where multiple relays are operating 
simultaneously in one group. The qualitative result of this work would not change by grouping nodes but only 
makes the analysis more involved. 
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Definition 1: A (2"^= , 2"^= , . . . , 2"^"^\ n, A„) code for the previously described system model consists of the 
following 

« A set of equally probable indices W = [1; 2"^] where R < X^S^^ ™d the corresponding rv. W over W. 

• The source encoding function fo : [1; 2""] X^. 

• The relay encoding functions fi^b ■ yl^''' ^' ^ '^[\ I G [^',N],b e such that the n-length sequence 
xi{b) in block b is given xi{b) = fhb{yi{l)., ■ ■ ■ ,yi{b - 1)). 

. The decoding function g : y2 ^ [1; 2"-^]. 

• The maximum probability of error 

A„ = maxPr{g(yd) ^ w|W = w} . (1) 
Definition 2: A rate R is said to be achievable if there exists a sequence of (2"^= , • ■ • , 2"^= , n, A„) codes 
with '^^jti ^ ^ such that A„ ^ as n ^ oo. 

III. Protocol description and achievable rates 

The encoding procedure of the mixed strategy is based on a block Markov superposition coding in B blocks and 
utilizes the following messages: 

> the source messages U^, k G [1;N + 1], with rates 

> the support messages Vf, I G [l;N],k £ [1;^], sent by relay level I with rates i?J to support the source 
message U^', 

> the quantizations Y^'^' , k' G with Mi = N ~ I + 1, used to quantize the channel output Y; in Mi 
successive refinement steps, and 

> the broadcast messages Wf with rates Rf , k' G [l;i\f;], to communicate the quantizations. 

The actual channel input X; at node / is then a deterministic function of the previously mentioned messages. We 
use further the regular encoding approach presented in [9] as it achieves in general higher rates than the irregular 
approach proposed in [7]. Consider the following description which explains the encoding and decoding procedure 
in some arbitrary block & G [l;B] and is illustrated in Fig. |2]for N = 2: 

a) Encoding in block b: The source divides its message into 1 partial messages U^. Furthermore, as the 
source node knows the mapping of source to relay messages applied at each relay node, it can support the relay 
messages, e. g., using a coherent transmission. 

In block b the relay level / supports the source messages sent in block b — I. Hence, assume that it decoded 
all source messages ui^ '' sent in block b — I. Then, it can use the decoded indices to select the corresponding 
messages from its own codebook. We assume that the relay also correctly decoded all source messages sent in 
blocks [b — N;b — I — 1]. Therefore, relay I knows all messages v{/'' sent by levels I' > I (as all codebooks were 
revealed to each relay node) and can support these subsequent levels. Furthermore, the relay node compresses the 
remaining uncertainty in its channel output by the quantizations where node o;(fc) decodes all y|^''^' using 

the broadcast messages W| ' sent by level I. 
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Yd : U^U^U^ 

Fig. 2. Information exchange of the mixed strategy for N = 2. 

b) Decoding in block b: Consider level I G [l;iV + 1] and the decoding procedure of the partial source 
message sent in block b — I + 1. Note that level I decodes the partial messages in ascending order such that 
when decoding all messages used to decode ui^ '^ ^' are known. At first, level I decodes the broadcast messages 
w[?l'^'°"^'^'^' sent by level fc — 1 in block b — I + k. Using these messages the relay can decode the quantization 
Y^^r^^*"'' for block 6 — ^ + 1 using its own channel output Y; as side information. 

The decoding of the source messages is done by searching for an unique message index such that the source 
message sent in block b — I + 1 and all support messages Vf_„j, m E [l-l — k], sent in block b — m+1 are jointly 
typical with the quantizations Yjtgj^^j,_j^j and the own channel output Y/ in block b — I + 1. 

Remark 2: Before we can proceed we must mention that there two substantially different ways of communicating 
quantization messages. The first alternative is to communicate quantizations for block b — I + 1 after decoding all 
source messages q\^'i^^_i^i- These quantizations can be used by all subsequent levels to decrease the set of jointly 
e-typical source messages sent in block b — I + 1. An alternative is to communicate in block b the quantizations 
for the channel output y/(6 — 1). This has the advantage that these quantizations can be used to decrease the set of 
jointly e-typical relay messages. Furthermore, using the latter one we only know the messages sent by level I — 1, 
hence the quantization is contains significant interference. We decided to use the former alternative as it is easier 
to generalize and seems to offer more benefits (beside the fact that it is less complex). 

c) The successive refinement problem: The previous description already reveals that the quantization of 
the relay channel output can be described as a successive refinement problem [12], [13] with unstructured side 
information at the receivers. Fig. [3] illustrates the successive refinement problem as it emerges in our proposal. The 
channel output of level I, i. e., Y;, has to be encoded and transmitted to nodes o/(z), i G [1; Mi]. At first the channel 
output is estimated by a quantization Y,^ with rate A^^ = Ryi{DI), where Ry,{D) is the rate-distortion function 
for some given distortion D. This estimation needs to be decoded by all nodes o/(z). Since these nodes can exploit 
(in general unstructured) side information yo,(i)y the necessary rate Rj < Aj to describe Y; at distortion Dj is 
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Fig. 3. The successive refinement problem as it emerges in our protocol. Y; needs to be quantized by encoders f},-' ' t fi ' different 
distortions and to be decoded by decoders So; ( 1 ) i ' ' ' 1 9oi(Mi)^ = ^ ~l~'r^^ which can exploit their own channel output as side information. 



9L1 



yi,2 



gi,M 1 — ►( 



ri'fci 

Fig. 4. The broadcast channel problem considered in our work. The indices 2j ' are determined by the Wyner-Ziv coding of the quantizations 
Y| ' and need to be decoded by receiver gi±, - ■ ■ ,gi.Mi, Mi = N — I + 1. 



given by the Wyner-Ziv source coding rate [14], i. e., i?,^ = max (I?,^), where is the Wyner-Ziv 

rate-distortion function as defined in [5]. In the next refinement step all levels o/(z), i > 2, additionally decode the 
more accurate description Y;^ with Df < D} . To describe the refined quantization Yf additional information at rate 
must be provided. Again from rate-distortion theory we know that + R} > max ^Yi^Y; i-^f )- l.^^]' 
[13] the Markovity condition to achieve rate-distortion optimal successive refinements is derived. In our setting this 
implies the Markov chain Y/ ^ Y*^' ^ Yf^'^^ ^ ' ' '^l- With this condition we can ensure that Y^*^ is at least 
for one node oj(i), i > k', rate-distortion optimal, i.e., V*^ , R] ~ max (D^ ). 

d) The broadcast channel problem: Fig. |4] illustrates the problem of transmitting the quantizations of level 
I, i.e., y{^'*^'', to the next Mi levels: the message indices {z^ , . . . , zf'^'), zf G [1;2"-'^' ], are determined by 
the quantizations Y^^ , . . . , Y^^^' using a random binning procedure [4]. As previously mentioned, nodes o;(i), 
i G [fc'; Ml], need the indices (z/, . . . , ) to successfully decode the quantizations Y;^, . . . , Yf . Our problem 
is characterized by a broadcast channel with the degraded message set w|^'*^'', which was analyzed by Korner and 
Marton [15]. Using the results of [15] we can state that 
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i?f< min l(wf;Y,.,|Wp^'=~'l) (2) 

is an achievable rate for our problem. As explained in [16, Corollary 5], Q is included in the capacity region for 
the case of Mi = 2: R} < I(W;i; Y/^), Rf < I(Wf ; Y,,2|W,i) and Rf + Rf < I(W;2; Y/,2) [15]. In the special case 
that Yoj(2) is not "less noisy" than ^01(1) [15], i. e., I(W;^; Y/ 1) > I(W[; Y/.2), we need to introduce a time-sharing 
and auxiliary random variable to achieve capacity [17]. Since the generalization of this method to prove the capacity 
region of our setting is beyond the scope of this paper we use (|2]l in the sequel. 

Based on the previous description we can formulate the achievable rates for the mixed strategy in Theorem [T] 
Theorem 1: With the previously presented protocol we are able to achieve any rate 

N + l 

R = sup max R^^ (3) 

p o,e7r([l;JV+l]) ^ 

iff 

< .elS^i]^ (u^;Y.Y;!^[S,_,|U^'=-1, {Vf,,l, Wf^^-^'^l : ^ G [1;^]}) + 

/-I (4) 

El (vf ; Y.|v[^^'=-^i {vf -1, w?^^'('^] + 1;^]} , vjS]) , 

j=k 

and n and B are sufficiently large. We further have to constrain the broadcast messages: 

k'=oi{k) (5) 



/e [l;7V+l],j e [l;Mi]. 
Finally, we have the following source coding constraints on the quantizations: 

in 

j'=oi(j) (6) 
/ e [l;N],m£ [1-Mi]. 

Eq. Q and ^ show the source-channel separation in our proposal which is suboptimal in general. The supremum 
in (O is over all pdf of the following form 

/ [i-Af+il [1;''] -IhMi] \ 

P[< ''Vze[l;Ar]'^.G[l;JV]'y^e[l;A]'y[Wl] ) = 



N+l 



I I fl;Af+ll [1:*] \ TT ( k\ 

P(y[l;7V+l]|uL' + ^W^gj^.^pV^gjj.j^jj ■ _[J_p(^uJu 

N 

n 



fc|,Ji;fc-i] .,k 

1 ^ie[k;N] 



fc=i 

N 



1=1 



I (7) 



.fe=l 



Mi-1 



fe=l 



IPIW,|W, ,V, IplyHU, >V^g[l;;]>V[;_^l;W]'^[l;/] 



Proof: See Appendix U 



IV. Results for the Gaussian channel 



In the following we apply the previously described mixed strategy to Gaussian multiple relay channels and 
evaluate performance and complexity of different protocols generalized by it. 
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A. Description of model 

Again, we consider a network of iV + 2 nodes where dj/j denotes the distance between nodes I' and I ^ V . Let 
d be the pathloss exponent, then the gain factor between both nodes is given in a log-distance path loss model by 
= ^^v^i ^ ■ Furthermore, let the channel input at node / be given by X; ^ CM (0, Pi), i. e., the channel input is a 
n-length sequence of i.i.d. Gaussian r.v.s with zero mean and variance a\ = n^^ S"=i E ||Xj[t]|^|. Our analysis 
uses Gaussian alphabets which are not necessarily optimal but easier to treat. The channel output at node I and 
time t is given by 

l'e[Q;N]\l 

where Zi ~ CAf{Q, Ni) is the additive white Gaussian noise. We further use the following messages 

• the partial source messages ~ CAf{0, 1), k €[1;N + 1], 
. the support messages Vf ~ CAf {0, 1), I G [1; N],k e [1; /], 

. the quantizations Yf' ~ CAf (o, TV, + J2^k' ^i) ^ k' e [1; Mi] with Mi=N-l + l, where J2f!lk' models 
the quantization noise to compress the channel output Y;, 

• and the broadcast messages Wf ~CA/'(0,1). 

The combination of the partial source messages and the support of the relay transmissions is done as follows: 

N + l / ^ \ 

Xs = VPsJ2 U<Uj + E(V<^Vf,) , (8) 

k=l \ l'=k / 

where P, is the source transmission power and ; is the fraction of power spent by the source node for the support 
of message level k sent by level I. The channel input at level I is given by 

/ I N M, \ 

X; = E E v^'^' + E V A'wf , (9) 
i'=i k=i I 

where ji^ defines the fraction of power spent by node / for broadcast message level k. Moreover, to meet the power 
constraints on all channel inputs, we must ensure that 



iV+l 

E 

fe=i 



N 



«t + E "^Xi' 



l'=k 



I N Ml 



<1, and EE<''+EA'<1- (10) 



fe=i i'=i k=i 
k 



In the case that no coherent transmission is possible it follows that = for Z 7^ V . 
B. Achievable rates 

Before we formulate the achievable rates, we need to derive some auxiliary variables. Due to the possibility of 
coherent transmission, the overall received power at level I' for message level k sent by level / is given by Tip 
and defined by 

I 



^M' = \ Y. {hj,i,^/alP;) + hs,,y/^sj , (11) 
^s,i' = hli.a^^Ps, and T^^^^, =YA? ' ^2) 
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Furthermore, the cross-correlation of message level k sent by level I and received at nodes m and m' is denoted 
as f and given by 



- l,m,m' — I hj-iri\J OL^j iPj 

\je{[k:l].s} 



-h h ,n,^ P and f 1 _ \^ f [^^^^ 1 



f [fc;fc'] 



(13) 



(14) 



The power of broadcast messages received at node / after decoding the broadcast messages of levels [fc; k'] is given 
by 



me[l;Af]\[fc;fe'] me[fc;fc'-l] 



(15) 



Finally, let us define the matrix K^'j as the covariance matrix of Y; and all decoded quantizations Yp^^^i.j_i^ when 
decoding the partial source message and knowing ui^ '' K The elements of the matrix are given by 



K 



p[j' + l;Af+l] 

;'e[;+i:Af],i,i ^ sj,i ' 

f[i+l;i'] -?,[j' + l;W+l] 

l'e[l + l;N],i,i' ' ' 



(16) 

(17) 

(18) 
(19) 



for € — 1] and i ^ i'. Using the previously given variables and the specific decoding scheme described 
above we can formulate Theorem |2] on the achievable rates in a Gaussian multiple relay network. 
Theorem 2: With the previously presented protocol we are able to achieve any rate 



N+l 



R = max R': 

o,e7r([l:Af+ll) ^ 



(20) 



k=l 



in the Gaussian multiple relay network iff 



i?„ < min log — r-,— 

ie[k-N+i] detif?-'^^ 



j^k 



(21) 



j=k \l/'6[iy_i],i +lj,i +^l'ell + l;N],l+^l +^sd 



and n and B are sufficiently large. We further have to constrain the broadcast messages using the following upper 
bound 

/ \ 

hlk'l^iPi 



R, < min C 



ke[j;Mi] 
k'^oiik) 



V 



^ l'ell:l-l],k' ~^ ^ l'elk' + l:N],k' + ^^k' 'H,k' 2^ Pl^l~^ ^ s,k 

i—1 

le[l;N + l],j e[l:,Mi], 



N+l] 



J 



(22) 
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Finally, we have the following source coding constraints on the quantizations: 

, , ,, , , , /fli' + i;''] j_f.[i + i;N + il\^ 

p[j +1;' 1 , .1,/ , AT _ Vi'eU' + i;N].j'.i+^ s.j'.i ) 

^fi i'e[j'+i;N].i ^ s.i pb'+i;i'i 1 r['+i;"+iUAi-j'4-Ar 
y7V/> max ■ ■ ^'eu'+M+ +^^^^ ^23) 

J =oi(j) 2'=i — 1 

Proof: See Appendix Ull ■ 



C. Numerical results 

In this section we apply the previously presented approach to the setup with N — 2 relay nodes illustrated in 
Fig- 13 In this setup aU distances are normalized to the source destination distance, i.e., ds,d = 1, rfs,i = ^2,^ = \r\ 
and di,2 = 1 - 2r. Furthermore, M Ni ^ N2 = ■ ■ ■ Nd, Ps = Pi = ■ ■ ■ Pn and 7^,^ = P^/Na = 10 dB. Other 
values of ^s,d would impact the quantitative statements given in the following but the qualitative statements remain 
almost unaffected. We compare the results of coherent transmission with noncoherent transmission for a pathloss 
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exponent 6 = 4. 

Before we analyze the results for the given setup we need to introduce some special cases of the presented 
approach which, as we see later, achieve its performance in certain scenarios: 

1) DF: The pure decode-and-forward case was presented in [7] where only one source message level is used, 
i. e., only and Vj^^jj^.^j are used. In this case the encoding and decoding complexity of the mixed strategy 
is minimized. 

2) CF: Assume the source node only uses the partial message Uf^+^ (by setting ai^l/^' = 0). In this case each 
relay node only transmits its quantization to the destination node. Hence, the decoding complexity at the 
destination is increased in comparison to the DF approach. Note that this protocol is comparable to the ideas 
of [10, Theorem 3]. 

3) PDF: This protocol relates to a parameterization with = 0, i. e., the relay nodes do not quantize their 
channel output. This partial decode-and-forward approach can be seen as a more general form of DF. 

4) Mixed CF/DF: The last special case can be applied for the two-relay case when the first relay node operates 
in CF mode to support the second relay node which operates in (single-level) DF mode. In this way the first 
relay helps to increase the rate towards the second relay which on the other hand can provide more additional 
information to the destination. 

Consider Fig. |6] which shows the maximum achievable rates for direct transmission (one hop), the presented 



February 2, 2008 



DRAFT 



SUBMITTED TO IEEE TRANS. INFORM. THEORY 



12 



approach and its special cases (except for the mixed CF/DF case which is discussed later) in the described setup 
when coherent transmission is possible. It shows that the PDF approach achieves the performance of the presented 
strategy at all r except for r w 0.5. This implies that the additional quantization stages provide only minor or no 
benefits. A less complex protocol is DF which for < r < 0.5 also achieves the performance of the described 
strategy at much less encoding and decoding complexity. A closer look on the actual parameters reveals that the 
performance difference between PDF and DF for r < is due to the fact that in DF all relays must decode the 
source message whereas in PDF an appropriate parameterization can be chosen such that one relay node is not used 
anymore. Hence, for r < the single hop DF and for < r < 0.5 the multihop DF achieve the best performance 
while requiring the least encoding and decoding complexity. We can further observe in both figures that the CF 
strategy does not achieve the other protocols' performance in the observed interval —0.5 < r < 0.5. This coincides 
with the results for one relay where CF can only achieve the general lower bound if the relay is placed closer to 
the destination (as in this region the broadcast cut is the limiting factor). In contrast to the one relay setup, we 
have in our setup always one relay node with a sufficiently good link to the source node such that CF would only 
achieve the rate of the mixed strategy for r < —0.5. 

Now consider Fig. |7] which shows the results when no coherent transmission is possible. In this case, the behavior 
of the presented protocols slightly changes, e. g., CF is now able to achieve the performance of the mixed strategy 
for r < and both PDF and DF only provide the best performance for 0.2 < r. This again coincides with the results 
for the one-relay case where coherent transmission only provides benefits for r < 0.5. Nonetheless, in the more 
interesting case (from a practical point of view) where the relays are place between source and destination, the 
DF approach again offers the best performance (and performs as good as PDF) which again shows that the DF 
approach offers the best complexity-benefit tradeoff in a wide range of scenarios. 

In both figures r — 0.5 represents a special point as none of the illustrated protocols achieves the performance of 
our approach. Consider again the mixed CF/DF strategy where the first relay node supports the second relay node 
by communicating its quantized channel output and the second relay node uses these quantizations to operate in 
single DF mode. At r ~ 0.5 this protocol achieves the best performance (the protocol is not shown as it does not 
provide any advantage at other values of r). 

References 

[1] E. van der Meulen, "Transmission of information in a t-terminal discrete memoryless cliannel" Dept. of Statistics, Univ. of California, 

Berkeley (CA), Tech. Rep., 1968. 

[2] , "Three-terminal communication channels," Advances in Applied Probability, vol. 3, no. 1, pp. 120-154, 1971. 

[3] T. Cover and A. E. Gamal, "Capacity theorems for the relay channel," IEEE Transactions on Information Theory, vol. 25, no. 5, pp. 

572-584, September 1979. 

[4] D. Slepian and J. Wolf, "Noiseless coding of correlated information sources," IEEE Transactions on Information Theory, vol. IT-19, no. 4, 
pp. 471^80, July 1973. 

[5] A. Wyner and J. Ziv, "The rate-distortion function for source coding with side information at the decoder," IEEE Transactions on Information 

Theory, vol. IT-22, no. 1, pp. 1-10, January 1976. 
[6] R Gupta and P. Kumar, "The capacity of wireless networks," IEEE Transactions on Information Theory, vol. 46, no. 2, pp. 388^04, 

March 2000. 



Febraary 2, 2008 



DRAFT 



SUBMITTED TO IEEE TRANS. INFORM. THEORY 



13 



[7] , "Towards an information tlieory of lai'ge networlcs; An achievable rate region," IEEE Transactions on Information Theory, vol. 49, 

no. 8, pp. 1877-1894, August 2003. 
[8] L.-L. Xie and P. Kumar, "A network information theory for wireless communication: Scaling laws and optimal operation," IEEE Transactions 

on Information Theory, vol. 50, no. 5, pp. 748-767, May 2004. 
[9] , "An achievable rate for the multiple-level relay channel," IEEE Transactions on Information Theory, vol. 51, no. 4, pp. 1348-1358, 

April 2005. 

[10] G. Kramer, M. Gastpar, and P. Gupta, "Cooperative strategies and capacity theorems for relay networks," IEEE Transactions on Information 

Theory, vol. 51, no. 9, pp. 3037-3063, September 2005. 
[11] T. Cover and J. Thomas, Elements of Information Theory. John Wiley & Sons, Inc., 1991. 

[12] V. Koshelev, "Hierarchical coding of discrete sources," Problemy Peredachi Informatsii, vol. 16, no. 3, pp. 31^9, 1980. 
[13] W. Equitz and T. Cover, "Successive refinement of information," IEEE Transactions on Information Theory, vol. 37, no. 2, pp. 269-275, 
March 1991. 

[14] A. Wyner, "On source coding with side information at the decoder," IEEE Transactions on Information Theory, vol. IT-21, no. 3, pp. 
294-300, May 1975. 

[15] J. Korner and K. Marton, "General broadcast channels with degraded message sets," IEEE Transactions on Information Theory, vol. 23, 
no. 1, pp. 60-64, January 1977. 

[16] I. Csiszar and J. Korner, "Broadcast channels with confidential messages," IEEE Transactions on Information Theory, vol. 24, no. 3, pp. 
339-348, May 1978. 

[17] I. Csiszar and J. Korner, Information Theory: coding theorems for discrete memotyless channels, ser. Probability and Mathematical Statistics. 
New York: Academic, 1981. 



This section proves Theorem [T] using the arguments developed in [9] as well as strongly e-typical sequences as 
defined in [11, Ch. 13.6]. The necessity for strongly e-typical sequences arises from the usage of quantizations 
which requires the Markov lemma [11, Lemma 14.8.1]. Before we can describe the proof in more detail we need 
to derive the following lemma which is a basic part of this proof. 

Lemma 1: Let the n-length tupel {x,y,u,w) be drawn from (X, Y, U,W) ^ p(x|u)p(y|u, w)p(w, u), then 



Appendix I 



Proof of Theorem[T] 




(24) 



where = is used as defined in [11], 



Proof: 





(25) 



(x,y,u,w)G^g 



(„) 



j^(n) 2-"(ff(X|U)-2e)2-n(-H(Y|WU)-2£)2-n(H(WU-£) 



(26) 



2ri(ff(XYWU)+£)2-n(-H"(X|U)-2£)2-n(H(Y|WU)-2£)2-n(H(WU)-£) 



(27) 



= 2 



(28) 
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where K is given by 

K = -i?(XYWU) + i?(X|U) + i?(Y|WU) + il(WU) (29) 

= I(X; W|U) + I(X; Y| WU) (30) 

'=I(X;YW|U) (31) 

and («) follows from the chain rule. ■ 
Corollary 1: Note that if the Markov condition X <-» U <-» W holds then 

I(X;Y,W|U)=I(X;Y|W,U), (32) 

as an immediate consequence of the chain rule for mutual information. 

A. Random coding 

We consider in the following iV + 1 codebooks Ci,i E [0; N], where in block b codebook Cfno(i(b,Af+i) is used. 
The sequences for each codebook are generated as described in the following. 

• Relay level N creates the sequences (qnIi^n'^ ^'j £ [^j^]j1n ^ which are drawn from 

^ P {jnW^n^^'''~^^ (^1n\1n'^ for each gj^'''""^'. Then it creates the broadcast messages ^zj^lgj^'^'^, 
zli e [1;2"^«], drawn from 

wjv^p(«;]vivji''^^'(9k^kr"'0)' ^^^^ 

where v^'^'*'"^' (^ivkiv'*"^') abbreviates the set jv^v (qn\Qn'^~^^^ '■ i ^ [1;^" The sequences are 
always generated in an ascending order, i. e., starting with all qlf G [1; 2"^=] and proceeding with increasing k. 



Furthermore, the quantization messages yj^ [rjf \ gF'^', j^fj./^j, -^i^ : i € [1; -^]})' ^jv 



1- 2"'^« 



, are drawn 



from 



"p(y^|ur"['^^l (qTk^^-'-'-'l U;N] i G [l;m]}) , 

for each gi^'^', |gfj.7v]i ~A '-^ ^ \^'- ^]|- further use the following random partitioning: Each r\j £ [1; 2"^"] 
is randomly assigned to one of the cells Zlj{zj^), zj^ G [1; 2"^«], according to a uniform distribution. 
Relay level I, I G [l;iV], creates the supporting messages vf (^qi\qf'''^~^\ q^^^lj^^ , k G [l;^],gf 
drawn from 



1;2 



~ P \^v; |V; \qi \qi , g[;+i.;v] ; ' \<li > %+\;N] J J ' 

for each qf'''^ ^' ' ^'z+'i at]- ^^^^ ^^^P create the broadcast sequences wf ^zf Izp'*^""^', g|^^.'j(Jj^, k G 

[1; M(], G 1; 2"^'° , which are drawn from 
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(37) 



for each zp'*^ ^' . q'j"';'^! . We further create the quantizations yj'^ (r^*^ | r|^''" ^' , qi^''' , , z^^ :i G 

[1; M,], rf e 1; 2"(^'^'^'"') , which are drawn from 

for each j-j^''^ ^',(7!^''', ^q[i.i^],zl : i e The joint pdf in (|7]i as well as the generation of quantization 

messages shows the Markov chain Y^^^' ^ y*^'^^ ^ • • ■ Y;^ which is used in the sequel in the context of the 
successive refinement problem. We further use the following random partitioning: Each r\ £ [1; 2"('^i~^! '] 
is randomly assigned to one of the cells Z^z^), z\ S [1; 2"^'], according to a uniform distribution. 



• The source generates the sequences u^' {q'l\q^}'^ ^\ ■ * ^ [1;^]}) with e [l;2"^i], k e [l;Af + l], 



drawn from 

^p(n^|ur^^'=-^l ('Zri'Z^'-^l, {-Zf,^] : ^ ^ [l;m]}) ,v*^f,^^j (gf |g?^^-^U|a^^.])) ^^^^ 
for each gi^'''"^' and : i e 

Note that all codebooks are revealed to all nodes in the network. 

B. Encoding 

Note that (/[^j^^^,,,^.^] = 0, (zj^^i!/] = and 9{^['^_jy+/+i._b] — which is known to all nodes. Consider now the 
encoding for block h: 

• At the source node 

In block h the source transmits the message indices ^g] b^' ' ' ' ^^b^^ ■ Assume all relays correctly decoded 
the previous N source transmissions, then the source knows the indices gj.gj^.jY] b ~ Is b-k ^^^'^ henceforth 
also the corresponding messages). Therefore, the source transmits the messages 

{< {<b\it'^^{^[k;Nlb ■■ke[l;l]}):le [1; N]} (39) 

from codebook Cnwd{b,N+i)- 

• At relay level I 

Assume the relay successfully decoded I^^Y-;' • ^' ^ [^;^]|- block b level / is supposed to transmit the 
indices gj^^'' = 9^6-;- further knows the indices transmitted by the subsequent relays 9|/^g|/_^i.jv] b '■^^ 
first I source message levels and can therefore support the transmission of these relays. 
Furthermore, let the relay found the quantization indices - - I'^fl'-i^ (we define in the decoding 

section how these indices are found). With rl,j_i E Zl{zl^),i G [1;M/], the node can create the mes- 
sages w\(z\^^]zfl'^'^\q\^^^^^),i e [I; Mi]. The relay finally transmits vf^'^''' {qf,b\qu'''^\ q\l+lN],b) 
W/ \^l,b\^l,b ^%-N],bj- 
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C. Decoding 

The decoding is described for some arbitrary node Z G [1; + 1], source message level k and block h. 

> At first we decode the quantizations communicated by level fc — 1 (for k > 1), i.e., the broadcast message 

indices and the corresponding quantization indices r\^!^itlf-l\^i- At first we decode the broadcast 

message indices Then, for each j € [1; (j)k^i(l)], we build the set 

-1 yk-i,b-i+k-i\^k-i,b-i+k-i^is,b-i+n \i[iM],h-i+iT ■ « t [ijfi- 'j J ' 

-1 (jk-\,b-i+k-i\A-i,b-i+k-i^iii'-i+i' [i[iM],b-i+i^ ^Ib-i+i ■ * e [1; - 1]}) : (40) 
^Mi) (^Mi) |„[i;0.(O-i] f^m i -m^U-A] 

where we dropped the block index 6 — Z + 1 if it is clear from the context. The set ^ holds all possible 

quantization indices fj^_i t-i+k-i ^^'^ search for such an unique index which maps to Zl_^{zl,_^ b-i+k) 
as follows 

^^k-l,b-l+k-l ■ ^fc-l,b-i + fc-l = Qi,k-l,b ^ (-^fc-l,b-i + fe) ■ (^^^ 



Remark 3: We must note that when decoding source message level k we can only decode the indices of 
nodes [fc; I]. Furthermore, we decode in this step only the quantizations of node level fc — 1 which exploits the 
quantization information acquired in the previous fc — 2 decoding steps (in the first step we do not decode any 
quantization information). 

• Using these quantization messages we proceed with the decoding of the source message Consider at 

first the following sets: 

^1 9j,6-i+l+j • i^j (9j,6-i+l+jkj,bl;+i+j,9|j + l;Ar],6-i+l+j) '^C^ - I + ^ + j) 

^ ^ , , (42) 

^[<is,b-i+i ■■ (ut^ (9tb-;+ikiX:7+i>{9[«;^],b-i+i ■■ * e [l;fc]}) Mb~l + l) 
^<t>Ai) (^4>Ai) „[!;''] r„j ^ • , p fl • /'I l^l (43^ 

yi'e[l;fe-l] y I' ,b-l+l' \' V ,b-l+l' T'is,b-l + n\%-N\,b-l+V^],b-l+l - J ^ [i,tjj-j 

for all i G [fc; Z — 1]. Note that we dropped in (l42l i and ( |43] l the block index h — I + \ + j where it is uniquely 
defined by the context. We finally decode q^ii_ij^i iff 

i-i 

^tb-i+i ■■ ilb-i+i = %M n fl Ti%^^ . (44) 

j=k 
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« Finally, if / < + 1, the relay needs to quantize its channel output in block b~l + l after decoding all source 
message indices q]^'^^_l_^_l■ This is done for a suitable quantization index f^^, j € [1;M(], such that 

4^.-^+1 ■■ * e [1;/]}) ,yK6 - ^ + 1), (45) 
uf ^'1 {vf ^'Uf - e [1;/]} , v^;i e ^:("), 

where we again dropped the block index 6 — Z + 1 if it is uniquely defined by the context. 

D. Definition of error events 

Consider the following error events which might occur using the previous decoding rule: 

• i?o.6: the error that all previously described r.v.s are not e-jointly typical in block h, 

• Ef^: the error that level I does not correctly decode in block b source message level fc e [1; /], 

• Efii ^: the error that level / does not correctly decode in block 6 the broadcast message k' G [!;(/);'(/)] sent 
by level V , 

• Efi, ^: the error that level I does not correctly decode in block h the quantization message fc' G [1; (t>i'{l)] sent 
by level V , and 

• Ef^: the error that level I does not find a quantization index k' in block h. 
Now let 

JV+l / l-l l-l 4>,'{l) Ml \ 

Fb = Eo,b u y [[jE^,u\j y [e^;,^, u e^;,^,) u y ^z;-; (46) 

1=1 y/c=l l' = l k' = l k' = l J 

where Pr = 0. We can use Pr {Fb\FI^_^ U -F'(f_2 U . . . F^pj^ to upper bound the probability of error in 

block 6. Besides, note that Pv {Fb\F§_^ U F§_2 U ... F§_j.^} = Pr {Fb\F§_-^ U F§_-^ U . . . Ff } as the error in block 
b only depends on the previous N blocks. 

E. Individual error events probabilities 

Before proving that the overall probability of error is arbitrarily small, we derive now the individual probabilities 
of the previously listed error events. 

1) Event -Eo.b-' This event is defined by 

Pr {EoAF[i.,-i, } = Pr { (u^^+^l , v^^,, , w^^^^, , y^^J^, , y[,,+,) ^ At^^^ } , (47) 

where we dropped the block index b to improve the readability. From Wyner-Ziv coding [5] as well as compress- 
and-forward [3, Theorem 6] we know that the proof for this events requires the application of the Markov lemma 
[11, Lemma 14.8.1] to ensure joint typicality. From the joint pdf in O we can define the following Markov chain 

^ ^ (48) 

(^[k+2-M,] Y TT[i+l;Af+l] v['+l'''l WP'^^'l Wl^'^^'l ^ 
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where Y;''^^ is substituted by Yi if k — Mi. After recursive application of this Markov chain starting with k = Mi 



- 1 

we know using the Markov lemma that 



where e ^ as n ^ cxd 

?k' 



Pr{i?o,6|^^fi;fc_i]} <£, (49) 



2) Event Ef^, When decoding in block h the broadcast message index zf, ^_;_|_;/^]^ we assume that 

(i?o,b U U U E^f -^^y (50) 

holds and we therefore know the message indices gf.'^]^,,_,+p+i, q^^lj, +^,i}^b_i+i. ^nd 
-^r if-i+l'+i- Using these indices we search for 

q-fc' ( k' ( ~k' I [l;fc'-l] [1;''] \ /. ; ^ _l i \ 

^^V ,b-l+l'+l ■ \^V,b-l+V + l\^l',b-l+l'+l^%';N],b-l+l'+l) ^yi\° ' + ' 



iG[l;fe'-ll ie[l;/'l 



{v^^wf^^-(')l:ze[/' + l;/]},v^;i,,)e^:(") (51) 



where we again dropped the block index b — I + 1' + 1 in the lower part for the sake of readability. If and only if 
n is sufficient large and 

< I (Wf;'; Y,|V|^''1, wjP'-^l, {Vl^^^ WI^^^'WI + 1;^]} , V[;4'l ^^j) , (52) 



we can state that 



Pr [e(i,^,\ [Eo,b U U El^f U i;^-'') '} = 

Pi-{Si'[b^i+i '+1 ¥= ^-i' ,b-i+i' +1 V (EB is not satisfiedj < e, (53) 
and e ^ 0. Eq. ( l53T l follows from Lemma [T] and Corollary [T] with substitutions 



^ ^ ^ ^ ie[l' + l;l-l]^ ^[l;N] ' ^je[i' + l:i-l]' 

as well as the fact that ^bL;+;/+i implies zf, — •^i' 6-i+z'+i if there is such a unique zf, ^_;_|_;/^]^. 

5) Event Efi, f^: When decoding rf, f,_;_|_;/ we assume that 

(^^0,6 Ui'fb^JVib-l] U A;;, U A,;, Uii,,, U ii, , ^ J ^ . , , _ ^ J U j , ^ [ ^ . , , _ ^ J J (54) 

holds, which implies that we know rj^^'^Ly^j,, gi^;,'Ji+i, ^'G^i-SS^i+i' if'tlhiU-i+i 

and (J'Ij'ij'I.^] Using these message indices we build the intersection of Q^^, and Zj} {zf, as defined 

in ( l40l i and dTTT i. From ^'[[,_jv 6-1] know that the correct quantization index is element of this set. The probability 
that (l4n i is satisfied can be given by 



Pr 



[e^i,^ {e,, U ^|,_,^,_, U E^i U E^*;-^ U U i^S^^^L,, U i^S^^^J^, J ^} < e, (55) 
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where e — > iff n is sufficiently large and 

A;^' - < Rf, + l(Yr; Y,, Y^[2,_„, {Vf,^^,, Wl^^*-«1 : ^ e [k; I]} 



W 



:2;0,(O] 



vk - 
^ I 



(56) 



with A" = 0. We applied in ( |56] l Lemma [T] with substitutions 

X - Yl^' U (Yi^^'-^l,U^''l, {V[,^], : ^ £ [1;^']}) 



u, 



Using the Markov structure of the quantization messages and the chain rule of mutual information we can build 
the sum over the quantization rates to get 

A;^' < l(Yr; Y,, Y^«,_„, {vf,^],W^*'«l : ^ G [k;l]} , 

k' . (57) 

wl|^;«l|u^n,{vf,^],w^^e [i;n}) + E ^^ 

i=l 

4) Event Ef^^: When decoding the source message index q^f,_;+i, we assume that 

{e,, U F,,_,,,_,, U E^t'' U E^^_^, U (58) 

holds, which implies that the indices g5e{o,[l;i-i]},b-i+i+,' 4t(-+i,i],b-i+i+r ^f+Ul.b-i+i+j 

and ^re known. According to (Hit we must prove that the correct index is the only element 
of the intersection 

i-i 

j=k 

where T^j^ q and T^^^ [k-i-i] defined in (l42T i and (|43] l. From ^"[^_jY.f,_i] we know that the correct index will be 
element of each these sets. Using Lemma [T] the probability that a wrong index is element of one these sets is 

2-n(I(v^Y,|vl^^-^{vl^-l.W^^*-<">:^e[, + l;^]},v[^;;l,)) ^^^^ 

and 

where 9^ t-i+i = '^j ^[6-Af b-i] holds. From the independence of the used codebooks we know that 

l-l 

■ n Pi" {^tb-i+i ^ <b-i+i A e T^lj} . 
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As there are 

2"«. _ 1 possible wrong indices it follows that 



j=k 

must hold and n ^ oo such that 



(62) 



(63) 



with e ^ 0. 



5) Event i?f Before we build the quantization index r^^ we assume 



Eo.b U F[b_jv;6-i] U Ef;^ U 4f 



(64) 



which implies that q^^f_i+^, ^[i-i],b~i+v <i^vi[iaib-i+v lte[i+i;Nlb-i+i ''ffi known. An error during 



the quantization occurs if (1451 1 cannot be satisfied, hence we can state that 
with e ^ iff n oo and 



|-^/,bK[i;b-i] I '■^/,b li^;,6 I '■^/J'e[l;/-l],b'l^^,i'e[l;/-l].f,/ 



< e. 



Af-Af' > I(Y?;Y, 



- 1 ' 



^,|Yr\U^'l,{vf,^^],Wi:ze[l;/]}) 



Af > I 



(Y^;YHU^'l,{vi,^^],Wi:ze[l;;]}) 



(65) 

(66) 
(67) 



which results from the rate distortion theorem [11, Theorem 13.2.1], the chain rule for mutual information as well 
as the previously discussed Markov structure within the quantizations. Using ( l57b we can state for the quantization 
source coding rates 



Y,ti^B:^l{DT)> .max 

' j'=oiU) 



If we use ( |67] | in ( |68] | it follows that 



I Yr;Y,v V 



Cr4>^U') 



Vf,.„,,W, 



i e 



[^ + 1;/]} 



w 



me[l;M,]. (68) 



max 

J elm: All] 
j'=oi(j) 



(Yr;Y,|U^'l,{v[,^^],W^^£[l;^]}) 



i e 



[I + 1;/]} , Wl^j^f) l|U^'l, {vf,^^],Wi : ^ e [1;/]} 



(69) 



Consider now the following mapping 



rlUMJ')] 



i e 



U^(u^'l,{v[,^^J,W^^e[l;^]}), 



[2;0.(j')] 



Yi 



0.0') 

4G[l;i-l] 



Yr 
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Due to the Markov chain X ^ (Y;,U) ^ (Y,W) it follows that H (^X|Yi,u) = H (^X|Yi, Y, W, which gr 
l(x;Yi|u) -l(x;Y,W|u) = H (^X|u) - H (^X|u) -H(x|Yi,u) +h(x|Y,W,u1 



= l[X;Yi\Y,W,\J 

Applying this result to ( |69] l we have 



Y^Rl=^rn^. l(Yr;Yi\Yr,Y^^^^^ : ^ e [l;f]}). (70) 

2=1 ./ \ 

F. Bringing all together 

The previous events were necessary to prove the error in block b. As we are interested in the overall error 
probability after B blocks, we need to consider the overall error probability Pe using standard techniques: 

Pe<Prl\jFA <Y,Pr [f, n } . (71) 

U=l J b=l 

Using the definition of Fi, in ( |46] | we get 

{N+l I l-l l-l 4>i'{l) Ml \ 1 

Eo.b U U U U U U (i?^,^, U E^;,^,) U U ^5 n I (72) 

1=1 yk=l l' = l k' = l k' = l J J 

N I l-l l-l<l>i'(l) Ml \ 

1=1 \k=l l' = l k' = l k' = l J 

Using this result in (fTTT l we have 

Pe < B {I + N {2N + N"^)) e, (74) 

which can be made arbitrarily small as n grows to infinity. Now lets apply the standard random coding argument 
by throwing away the worse half of codewords. It follows for the overall rate 

(75, 

nB 

which approaches i? as n — > oo and then B ^ oo. This and the previously given bounds prove that R in Theorem 
[U is achievable with arbitrarily low probability of error. 

Appendix II 
Proof of Theorem[2] 

In order to prove Theorem|2] we apply in this section Theorem[T]to the complex Gaussian multiple relay network 
presented in Section HVl 
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Rates on source messages: Reconsider the source rate constraints given in Q for the DMC. Now it follows 

forl(v^^;Y,|v[^^^-^lV 



N 



h(Yrf|v[^^-''l),jG[l;iV] 



N 



i-1 



' N 



k=l 
3 



fe=i v 



TV 



(76) 



(77) 



Af;fc 



with the differential entropy [11, Eq. (9.34)] 

h(X= (Xi,...,X„)) = log((2^e)"detKx), 



(78) 



and Kx being the covariance matrix of the multivariate Gaussian r.v. X. Now reconsider the definitions in 
( fTTT ). ( fnt and ([T5]l for Tf and Af''" , respectively. With these definitions it follows 



I 



(v^^;Y,|vli^-'"-^l) =log 



;=i V fc=i / k=i 



C 



k=l 



k 

N.d 



[j + l;Af] ^ j^d,d _L 



(79) 



(80) 



■ lell;N-l],d~^ ^ N,d "Tii^ -TJ-s ,; -r lU 

with the capacity function C(a;) — log(l + x). In a similar way we can show 



I 



< c 



0.(/+fe)] . . 



e[; + i;Z + fc]},v[^4':_,%) 



^ l,l + k 



^ l'elia-l],l+k ^ ^ i,i+fc ^ ^ i'e[i+fc+l;A'],i+A; ^ ^"-i+fc 



.l+l.l+k p[l;N+l] ^ 



le [l;N~l],je [l;l],ke [l;iV-/ + l]. (81) 
Finally, reconsider the definitions in ( fT3T l. ( fT4] l and (fT6]l-(fT9]l which are used to derive the first term in 



ie[l:j-l] 



|u^-ii,{^ 



[1:0, (fc)] 



i e [1 



h(Y.,Y::![^;)„,,|U^-il,{vf,^,,W^*'('=)l : z e [1 



-]}) 



h(Y.,Yf^f)_,,|U^l,{vf,^],wf^^'W^ z G [1;^ 
log ((2^e)^' det i^i' fc''-'"') - log ((27re)-'' , 



= log 



(82) 
(83) 
(84) 
(85) 

(86) 
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Now it follows for the source rates i?* using the previous results: 

,/£-l,fc-l \ 



< min log 

le[k;N+l] 



det k: 



dctK 



k-l,k 
,1 



/-I 



N, 



(87) 



Rates on broadcast messages: Using the previous description it is immediately possible to state for the 
broadcast message constraints in (|5]): 



Rj < min C 
k€[j;Mi] 

k' = oi{k) 



Kk'KPi 



i'e[i;;-i 



^[k' + ld'] 



e[l;;-l],fc' ' l'e[k' + l;N],k' ' "-fe 



l;Af+l] 



I 



(88) 



;e[l;iV + i],je[l;M,]. 

• Rates on successive refinement conditions: Reconsider the necessary side condition on the successive 
refinement conditions given in (|6]l. We can significantly simplify this condition to 



Y.K> , max l(Yr;Y;|Y,,,U^'l,{v[,^j,wf^^'(^''l : ^ e [!;/]}),/ £ [l;iV],m G [l;Af,] 
which is a result of the following inequality 



(x;Yn 



Y,-,Y,W,U 



(a) 



I X;Yi|U -I X;Y,v,Y,W|U 



I (X; Yilu) - I (X; Y,s W|U) - I (X; Y|Yy , W, U) 



>o 



(89) 

(90) 
(91) 

(92) 

with the mappings 

U^(u^'l,{vi,^jv],Wi:ze[l ;/]}), 

Furthermore, (a) and (c) follow the arguments already applied in (|69] l and (6) uses the chain rule for mutual 
information. Let us again use the previous mappings and consider the following equalities: 



< I(X;Yi|Yj,,W,U 



Y 



ie[l;i-l]' 



l(x;Yi|Yj.,W,U 



h Y^l Yy , U, W - h Y[" I Y, , Yy , U, W 



(a) 



h(Yr|Y,.,U,w) -h(Yr|Y,,u) 

h ftr, Y,v |U, W) - h (Yy |U, W) - h fYriYi, U) , 



(93) 
(94) 
(95) 
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where (a) exploits the Markov chain Y™ ^ (Y;,U) ^ (Yjv, W). The third term in ( |95] l is given by 



h(YnY,,u) = h(Yi,f, + Y,Zl,\Yi,,,V 



i—in 
Ml 



= log 27re^7VM. 

\ i—m / 

The second term in < l95b is given in the same way by 

h (Y,, |u, w) = log h.e (rl^it^S^^,,^, + r[:+i^^+ii + A^f' + N, 



Finally, the first term in ( |95] l is given by 

h(Yr,Y,.|U,w) =log((27re) 
with the covariance matrix KJ™ , given by 

K'] M =Var (tr |U, W) = rl^^2;^l. + rSir + + ^ + E 
=Var (Y,, |U, W) = T^'^^pg^,, + T^^^''^'^ + Aj/ + N, 

f.{j' + hl'] _^p[l+l;N+l] 



Ml 



(96) 
(97) 

(98) 
(99) 

(100) 

(101) 
(102) 



[Ku'] -Gov (tr |U, W; Y,, |U, W j = ^\!<^,+uNir, - ^ 

where we used the definitions given in (fTsT i and (fT4l) for Fj'^jj^ Finally, using (|97]l-(|99]l in ( [89] l it follows 
that 



> .R? > max log 

^ je[m;M,] 

' j'=oi{j) 



dot fs:/;^., 



VV.5 



l'e[]' + l;N]d' ^ «J 



(103) 



Since determinant of KJ" , is given by 



det Kl']^, = Var (y[" |U, w) Var (Y^v |U, W) - Gov (y[" |U, W; Yf |U, W 



(104) 



it follows for (fT03b : 



.R? > max = C 

^ 3e[rn:Mi] 
3 ^oi{j) 



( 



p[j'+i;i'] 
^ /'Gb'+i; 



r 



[/+l;Ar+l] _L A^'^'' 



,1 



N, 



V 



Ml 
i—m 



f[i'+i;i'] p[/+i;W+i] 
^ ve[j'+i;N],j',i ^ 



Using ( 11051 ) we get the constraints on the quantization noise variance given in ( |23] ). 



(105) 
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